
METHOD AND DEVICES FOR DISPLAYING IMAGES FOR VIEWING WITH 

VARYING ACCOMMODATION 



Priority is claimed under 35 U.S.C. 1 19(e) from U.S. Provisional Application 
Serial Number 60/264,812 filed January 29, 2001 . 



1. Technical Field 

The present invention relates to acquiring images and, more particularity, to 
displaying such images for viewing with varying accommodation. 

2. Discussion of Related Art 

The granularity of a given static man-made image of a real object is only as good 
as that of the imaging technology used to acquire and present it. Closer inspection with a 
magnifying glass or other aid to eyesight does not ultimately reveal any deeper 
granularity but only the limitations of the imaging technology used. This is not usually a 
problem for the enjoyment of images in books, movies, and other conventional media. 

On the other hand, the granularity of real objects is unlimited as far the human eye 
is concerned. Considering the eye itself, with increased focus, more detailed granularity 
of objects is always revealed. Moreover, with technological aids to the eye, e.g., the 
magnifying glass, the optical microscope, the electron microscope and other scientific 
tools, smaller details are always revealed. 

A recent motion picture or video innovation provides successive images to the eye 
at varying apparent distances for viewing with correspondingly varying focus 
(accommodation) of the eye. With increased magnification merely at the viewer's end, 
however, because of the limitations of man-made imaging technology, there is not any 
increased level of granularity available for inspection. If the magnification is also 
increased at the camera end there will be increased granularity but the viewer with 
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increased accommodation will focus on only a small part of the entire field-of-view 
presented. The effect is reduced granularity. Therefore, the verisimilitude of the imagery 
under increased magnification is a problem. 



An object of the present invention is to provide images of objects in a scene at 
varying distances that provide increased granularity to close-ups. 

According to a first aspect of the present invention, a method is provided 
comprising the steps of projecting light from an image projector, in response to an image 
information signal, controllably refracting said projected light, in response to a first 
control signal, for projecting refracted light for providing viewable images of varying 
extent, and controllably refracting said viewable images in response to a second control 
signal for viewing said images of increasingly smaller extent with correspondingly 
increasing magnification. 

According to a second aspect of the present invention, a device is provided, 
comprising a projector, responsive to an image information signal, for providing first 
light rays, a first optic, responsive to the first light rays and to a first control signal, for 
providing second light rays, a screen, responsive to the second light rays, for providing 
third light rays indicative of images of varying size, and a second optic, responsive to the 
third light rays and to a second control signal, for providing fourth light rays for viewing. 

According to a third aspect of the invention, a device is provided, comprising 
an image projector for projecting light in response to an image information signal, a first 
optic for controllably refracting said projected light, in response to a first control signal, 
for providing light rays of varying extent, and a second optic for controllably refracting 
said light rays in response to a second control signal for providing light rays of 
increasingly smaller extent at correspondingly decreasing focal length. 

These and other objects, features, and advantages of the present invention will 
become more apparent in light of a detailed description of a best mode embodiment 
thereof which follows, as illustrated in the accompanying drawing. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows a system including a device for showing images to an eye of a user. 

Fig. 2 shows a video camera collecting images of a scene illuminated by a light source 
with an eye of a cameraman shown using an eyepiece to view the scene being 
photographed and having a sensed eye signal encoded along with video information. 

Fig. 3 shows light rays projected to form an image that fills or almost fill the entire area 
or extent of a screen. 

y, 

q Fig. 4 shows light rays projected to form an image that only partially fills the entire 
G extent of the screen. 

m 
s; 

43 Fig. 5 shows light rays projected to form an image that only fills a small extent of the 

p entire extent of the screen. 

m 

W Fig. 6 is similar to Fig. 1, except the control signal is sensed not from the eye of the 

o 

cameraman, but from the eye of the user. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 



Fig. 1 shows a device 10 for showing images to an eye 12 of a user. A video 
signal is received on a line 14 by a control 16. The video signal contains image 
information which is decoded and provided on a signal line 18 to for instance an image 
projector 20 which projects images with first light rays 22 to a first optic 24. The optic 
24 may for instance be lens that is under the control of a control signal on a line 26 from 
the control 16. The control signal on the line 26 is decoded by the control 16 from the 
video signal on the line 14. The optic 24 refracts or otherwise bends the light rays 22 into 
second light rays 27 that are projected onto a translucent screen 28 to form images of 
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different sizes, i.e., that fill the screen 28 to a greater or lesser extent as shown in Figs. 3- 
5, as discussed below. The images on the screen 28 are projected as third light rays 29. It 
should be realized that the screen need not be translucent but could be reflective. The 
signal on the line 14 can be provided in many different ways. It should first of all be 
realized that the signal on the line 14 need not be a single line (which implies some form 
of multiplexing) but could be two or more signal lines. 

Secondly, as a first example of a way to provide the signal on the line 14, 
referring to Fig. 2, a video camera 30 is shown collecting images of a scene 32 
illuminated by a light source 34. An eye 36 of a cameraman is shown using an eyepiece 
38 for viewing the scene being photographed. A sensor 40 such as an eye 
accommodation sensor senses the accommodation of the eye 36. The sensor 40 provides 
jf a sensed signal on a line 42 to an optic control 44. The optic control 44 provides a 
p camera optic control signal on a signal line 46 to a motorized camera optic 48. The optic 
J control 44 causes the motorized optic 48 to focus on the scene 32 at differing focal 
•g lengths according to changes in the accommodation of the eye 36 as detected by the 
£} sensor 40. The optic 48 casts rays 50 onto an image sensor 52 that provides a video 
* image signal on a line 53 to a combiner 54. It combines, e.g., in a time division 

hat 

h* multiplexed way, the image signal on the line 53 with the signal on the line 42 to form 

Hi 

u\ the video data signal on the line 14 (see Fig. 1). As explained above, the signal on the 
P line 42 could be provided in parallel on a separate signal line alongside the signal on the 
line 14. In that case, it would only carry video information. 

Referring how back to Fig. 1, it will be realized from the foregoing that the 
control signal on the line 26 changes the projected light rays 22 by means of the optic 24 
according to changes detected in the cameraman's eye 36 of Fig. 2 by the sensor 40. In 
other words, the signal on the line 42 from the sensor 40 is not only used to control the 
optic 48, but is encoded in the signal on the line 14 along with the image information and 
used also to control the optic 24. The nature of the change in the projected light rays 22 
is manifested by the manner in which the light rays 27 are projected onto the screen 28. 
Examples are shown in Figs. 3-5. If the eye 36 of Fig. 2 is detected by the sensor 40 
viewing the scene 32 with a long focal distance, such as infinity, the optic control 44 
causes the optic 48 to focus at a correspondingly long distance. The optic 48 focuses the 
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scene 32 at infinity and projects the details of the scene with a wide field of view onto the 
image sensor 52. Consequently, the available sensor 52 pixels are spread over a 
relatively wide field of view. In other words, the granularity of the image is spread over 
a wide field of view. Fig. 3 shows the light rays 27 projected to form an image 54 that 
fills or almost fills the entire area or extent of the screen 28. 

If the eye 36 of Fig. 2 is detected by the sensor 40 viewing the scene 32 with an 
intermediate focal distance, the optic control 44 causes the optic 48 to focus at a 
correspondingly intermediate distance. The optic 48 focuses the scene 32 at the 
intermediate distance and projects the details of the scene with an intermediate field of 
view onto the image sensor 52. Consequently, the granularity, i.e., the available sensor 
pixels are spread over a relatively intermediate field of view that is less in extent than the 
relatively wide field-of-view 54 of Fig. 3. Fig. 4 shows the light rays 27 projected to 
O form an image 56 that only partially fills the entire extent of the screen 28. 
Sf If the eye 36 of Fig. 2 is detected by the sensor 40 viewing the scene 32 with a 

J short focal distance, the optic control 44 causes the optic 48 to focus at a correspondingly 
short distance. The optic 48 focuses the scene 32 at a correspondingly short distance and 
p projects the details of the scene with a narrow field of view onto the image sensor 52. 
J Fig. 5 shows the light rays 27 projected to form an image 58 that only fills a small extent 
y of the entire extent of the screen 28. Consequently, the available sensor pixels are spread 
jjj over a relatively narrow field of view 58 that is less in extent than the intermediate field 
of view 56 of Fig. 4. Particular objects within the narrowed field of view 58 of Fig. 5 can 
be viewed with more granularity than those same objects could be with the granularity 
provided by that of Fig. 4 and even more so than that of Fig. 3. 

Referring back to Fig. 1, as explained above, the light rays 27 are projected onto 
the screen 28 with different fields-of-view, areas or extents 54, 56, 58, all of which have 
the same total number of pixels. The advantage of this approach is that with the aid of an 
optic 60, the field of view of the eye 12 of the viewer can be fully occupied with all of 
these pixels even though the accommodation of the eye 12 changes. The total number of 
pixels can be spread over the full used extent of the retina in all cases by a combination of 
changes in the focal length of the optic 60 and the accommodation of the eye 12. When 
the optic 48 of the camera 30 of Fig. 2 focuses in on a detail of the wider scene 32, it 
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increases the granularity of the imaged scene in that area. At the same time, the optic 24 
causes the size of the image to be reduced on the screen 28. In other words, when the 
focal length of the optic 48 is shortened to capture a narrowed field of view of the scene 
with increased magnification, the granularity of that smaller portion of the imaged scene 
increases as manifested in a smaller area on the screen 28. The focal length of the optic 
60 is controlled by a control signal on a line 64 from the control 16 to allow the eye 12 to 
accommodate, i.e., to focus closer onto the scene with increased granularity in a smaller 
area of interest. In other words, at the same time that the control signal on the line 26 
causes the optic 24 to reduce the extent to which the screen 28 is filled by imagery (see 
Fig. 4), the signal on the line 64 causes the optic 60 to reduce the field of view provided 
^ for the eye 12, e.g., by increasing its magnification. Thus, the optic 60 refracts the rays 
0 29 to provide fourth light rays 65 in such a way that the eye 12 must change its 
JH accommodation so as to bring the image into focus. This causes the field of view of the 
j2 eye 12 to be fully occupied with an up-close image. 

® If the cameraman's eye 36 changes to a long view of the scene 32, as explained 

, above, the image 54 (Fig. 3) fills the screen 28 because the control signal on the line 26 
jjj* causes the optic 24 to expand the extent to which the screen 28 is filled by imagery. At 
[U the same time, the signal on the line 64 causes the optic 60 to expand the field of view 
p provided for the eye 1 2, e.g., by reducing its magnification or increasing its focal length. 
5 y The eye 12 changes its accommodation accordingly. In other words, when the control 
signal on the line 26 causes the optic 24 to increase the extent to which the screen 28 is 
filled by imagery, as in Fig. 3, the signal on the line 64 causes the optic 60 to increase the 
field of view provided for the eye 12 even further, e.g., by decreasing its magnification 
even more. 

Fig. 6 shows a variation of Fig. 1 where instead of sensing the cameraman's eye, 
the eye of the user is sensed. As shown, an eye sensor 70 senses an eye of a user, for 
instance by sensing accommodation. A control signal having a magnitude indicative 
thereof is provided on a line 74 to a control 76 which provides it on a line78 to a network 
80. The network provides the control signal on a line 82 to a camera 84. An input/output 
device 86 is responsive to the control signal on the line 82 and provides it on a line 88 to 
an optic control 90 which controls a lens 92 by means of a signal on a line 94. In this 
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way, the camera's magnification is controlled remotely by the user's eye 72 instead of 
locally by a cameraman's eye. 

At the same time, light rays 96 focused by the lens 92 and cast upon an image 
sensor 98 are converted to an electrical signal on a line 100 and provided to the 
input/output means 86 for transmission on the line 82 via the network and the line 78 to 
the control 76. An image signal is provided on a line 102 to a projector 104 for projecting 
light rays 106 to an optic 108 for projection as rays 110 onto a translucent screen 1 12. A 
backlit image formed on the screen 1 12 provides light rays 1 14 to an optic 1 16 that 
projects rays 1 18 to the eye 72 of the user. Besides controlling the lens 92, the signal on 
the line 74 is used by the controller 76 to provide optic control signals on lines 120, 122 

h*. for controlling the optics 1 08, 1 1 6 in providing images with differing field of view at 

D 

g different sizes as shown in Figs. 3-5. 



£ accommodation. For instance, eye direction could be sensed. Moreover, it should also be 

Co 

g realized that the control signal need not be derived from a sensed eye at all. It could be 
* provided for instance by a mouse or other control device employed by the user, by the 

cameraman, by a director, or by someone else to control magnification of the imagery. 
Jn Likewise, the imagery need not be obtained from a camera, but could be generated from a 
P computer or a drawing, painting, or hand-drawn animation. Although a real image is 

shown projected onto a screen, the optics 1 08, 1 1 6 could be arranged to present a virtual 

image to the eye of the user without any intermediate screen. It should also be realized 

that the imagery could be provided as stereoscopic images 
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It should be realized that the sensed property of the user's eye need not be 
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